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Definition 1. Let A= {a;;}, B = {bj;} and C = {c,;} be three matrices. Then C = A+ B is 
called the addition of the matrices A and B if ej; = aij + bj; for all i and j. 


8 


Definition 2. Let A = (a;;) be an m x n matrix and B = (bq) an n x p matrix. Then the 
product AB is an m x p matrix C = (cy) where, 


n 
ci = y Gikdgl 
k=1 


where 1 <i<mand1<l<p. 


8 


Definition 3. The expression obtained by eliminating the n variables x71,...,£, from n equations, 


ayry +... + QAinLyn = 0 
(1) 
Anit1 +... + Anntn = 0 


is called the determinant of this system of equations, Equation 1. The determinant of matrix A 
denoted by various different notations, for example det(A), |A|, )>(+a1bec3---), D(aibec3---), or 
|a1bec3 BreAt |. 


8 


Example 1. For a linear system of three variables, Equation 1 can be written as, 


a,x + aay +a3z = 0 
bx + boy +r b3z =0 (2) 


Cx + Coy + ¢3z = 0 


Eliminating x, y and z from Equation 2 gives us, 
aybecg — a ,b3co + a3b1 cg — agb1c3 + agb3c1 — agbec, = 0 


Definition 4. A minor M;, of any matrix A is the determinant of a reduced matrix obtained by 
omitting the i*® row and the j*® column of A. 


8 
Theorem 1. Determinant can be determined by, 
k 
| A | = S- aig Ci; 
i=1 
where Cj; is called the cofactor of a;;. The cofactor C;; can also be denoted as a’), and, 
Cig = (“1 Mig 
where Mj; is a minor of A. 
8 


Problem 1. Prove Theorem 1,the theorem for finding the determinant of a matrix by Laplacian 
expansion. 


8 


Definition 5. Any pairwisely ordered pair in a permutation p is called a permutation inversion 
in pift>j and p; < pj. 


8 
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Theorem 2. Determination of the determinant can also be determined by, 


|A|= ys (pn II Qi x (i) 
i=1 


us 


where 7 is a permutation which ranges over all permutations of {1,...,n}, and I(z) is called the 
inversion number of 7. 


8 


Problem 2. Prove the theorem for the determination of determinant by permutation, Theorem 
2: 


8 
Theorem 3. Let a be a constant and A an n x n matrix. Then, 
|aA| =a"|A| 
[=4[ =F A 
|AB|=|A||B| 
|Z] =|AA™*|=|A||A*] =1 
1 
[A |=Se 
| A~* | 
8 
Problem 3. Prove Theorem 3, the theorem on properties of determinant. 
8 


Definition 6. A function in two or more variables is said to be multilinear if it is linear in each 
variable separately. 


8 
Theorem 4. Determinants of matrix are multilinear in rows and columns. 
8 
Example 2. Consider an 3 x 3 matrix, 
a ag a3 
A= a4 a5 a6 
a7 ag ag 
What Theorem 4 says about multilinearity of determinants amounts to saying that, 
ay O O 0 a. O 0 O ag 
|A|=|]a4 a5 ag|+]as a5 ag|t+]as a5 a6 
a7 ag ag a7 ag ag a7 ag ag 
and 
a, ag a3 0 ag ag 0 ag ag 
|A|=]| 0 as ag|+]a. as ag|/+] 0 as ag 
0 ag ag 0 ag ag az ag ag 
Problem 4. Prove the theorem on the multilinearity of determinants, Theorem 4. 
8 


Definition 7. A conformal mapping is a transformation that preserves local angle. The terms 
function, map and transformation are synonyms. 


8 


Definition 8. A similarity transformation is a conformal mapping the transformation matrix of 
which is, 


A’ = BAB"! 
Here A and A’ are similar matrices. 
8 
Theorem 5. Similarity transformation does not change the determinant. 
Proof. The proof for this is simply, 
1 
|BAB™|=|B||A||B |= Alay =|A| 
4 
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Example 3. 
|B-1AB—AI|=|B-1AB-— BIB 
=|B-\(A—AIB| 
=|B||A-AI||B| 
=|A-AI| 


Definition 9. Let A be a square, n x n matrix. Then the trace of A is, 


Tr(A) = s Ay 
i=1 


Definition 10. The transpose of a matrix A = {a;;} is AT = {aj;}. 

8 
Definition 11. The complex conjugate of a matrix A = {a;;} is A = {@;;}, where @ = p — qi if 
a=pt+q. 

8 
Definition 12. Let ¢(n) or ¢(x) be a positive function, and let f(n) or f(a) be any function. 
Then f = O(¢) if |f| < Ad for some constant A and all values of n and x. Here O is called the 
big-O notation which denotes asymptoticity. The notation f = O(@) is read, ‘f is of order @’. 


8 
Theorem 6. Some other properties of the determinant are, 
|A|=|A?| 
|A|=|A| 
|1+eA|=1+Tr(A) + O(e?), for € small 
8 
Example 4. For a square matrix A, 
a. switching rows changes the sign of the determinant 
b. factoring out scalars from rows and columns leaves the value of the determinant unchanged 
c. adding rows and columns together leaves the determinant’s value unchanged 
d. multiplying a row by a constant c gives the same determinant multiplied by c 
e. if a row or a column is zero, then the determinant is zero 
f. if any two rows or columns are equal, then the determinant is zero 
Problem 5. Prove the properties of determinant given in Theorem 6. 
8 
Theorem 7. Some properties of matrix trace are, 
Tr(A) = Tr (A) 
Tr(A + B) = Tr(A) + Tr(B) 
Tr(aA) = a Tr(A) 
8 
Problem 6. Prove that, 
(AT) =(47)" 
8 
Theorem 8. 
(AB)? = BT AT 
Proof. oe ; 
(BrA . ( yy (a lig 
= bei jr 
= AjrbK: = (AB)5i = (AB);, 
4 
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Definition 13. Let A be a square matrix. Then the inverse of A, if it exists, is A~! such that, 
AA =I 


Furthermore, A is said to be nonsingular or invertible if its inverse exists, otherwise it is said to be 
singular. 


8 


Example 5. For a 2 x 2 matrix, 


the inverse of A is, 
1 d —b 
Ah 
ad — be le a 


If A is a 3 x 3 matrix, then the inverse of A is, 


At = 7 {det (ms)} 


where m4; is a minor of A. 


If A is an n X n matrix, then A~! can be found by numerical methods, for example Gauss-Jordan 
elimination, Gaussian elimination, and LU decomposition. 


Example 6. The Gaussian elimination procedure solves the matrix equation Ax = b by first 
forming an augmented matrix equation [Ab] and then transform this into an upper triangular 
matrix [{ai, } b’], where aj, are all zero except when i < j. Then, 


The Gauss-Jordan elimination procedure finds matrix inverse by first forming a matrix [A J], and 
then use the Gaussian elimination to transform this matrix into [J B]. The result matrix B is in 
fact Avt. 

The LU decomposition forms from the matrix A a product LU of two matrices, one lower- while 
the other upper triangular. This gives us three types of equation to solve, namely when i < j, 1 = J 
and 7 > 7, where i and j are the indices of row and respectively column of the matrix product. 
Then, 

Ax = (LU)x = L(Ux) =b 


Letting y = Ux we have Ly = b, and therefore, 


where 2 = 2,...,n. Then since Ux =y, 
Yn 
t.= 
Unn 
n 
1 
Ly = Yi ; UjjX; 
Nii ie 
j=it+l 
wherei1=n—1,...,1. 
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Theorem 9. Let A and B be two square matrices of equal size. Then, 
(AB) = B37 A-! 
Proof. Let C = AB. Then B = A~!C and A = CB“, therefore, 
C = AB = (CB) (AC) =CBA'C 


Hence CB-1A7! = J, and thus B-1A~! = (AB)7}. q 


Definition 14. The Einstein’s summation is the simplification of notation by omitting a summa- 
tion sign, keeping in mind that repeated indices are implicitly summed over, for example }>; ai,ai; 
becomes a;,a;;, and >>, a;a; becomes a;a;. 

8 
Definition 15. The multiplication of two matrices A = {a,;;} and B = {b,;} is the matrix 
C = AB such that Cik = aig djK- 

8 


Theorem 10. The matrix multiplication is associative. 


Proof. 
[(ad)c],; = (ab) inch; = (Gide) Chy = it (binCks) = ait(be)1z = [a(be)];; 


4 


Example 7. From Theorem 10, which shows us the associativity of matrix multiplication, we 
could write the multiplication of three matrices as [abc];;, which is the same as writing ajbi_Cx,;. 
And this applies in a similar manner to the multiplication of four or more matrices. 


Theorem 11. If A and B are two square and diagonal matrices, then AB = BA. But in general 
matrix multiplication is not commutative. 


8 


Problem 7. Prove Theorem 11, which is a theorem about non-commutativity of matrix multi- 
plication. 


8 


Definition 16. A block matrix is a matrix which is is made up of small matrices put together, 
for example, 


A B 
C D 
where A, B, C and D are matrices. 
8 
Theorem 12. Block matrices may be multiplied together in the usual manner, for example, 
Cy Di Cp De “s C,Ag+ DiCp C,Bo+D,Do 
provided that all the products involved are possible. 
8 
Problem 8. Prove Theorem 12. 
8 


Definition 17. Let A= {a;;} be an n x n matrix. Then A is called a diagonal matriz if aj; = 0 
when i 4 7. Here 1 < 7,7 <n. In other words, a diagonal matrix has its components in the form 
Qij = C047, Where cj is a constant and 6;; is the Kronecker delta, 


8 
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Theorem 13. A square matrix A can be diagonalised by the transformation A = PDP~!, where 
P is made up of the eigenvectors of A and D is the diagonal matrix desired. 


8 


Problem 9. Prove Theorem 13, the theorem on matrix diagonalisation. 


8 


Example 8. Matrix diagonalisation can greatly help reducing the number of parameters in a 
system of equations. For instance, the systems Ax = y when diagonalised becomes PDP7!x = y, 
that is Dx’ = y’, where x’ = P~!x and y’ = P~'y. In this case, if A is an n x n matrix, we say 
that our new system obtained through the process of diagonalisation has canonicalised from n x n 
to n parameters. 


Definition 18. A symmetric matrix is a square matrix A which satisfies A? = A. 


Example 9. If A is a symmetric matrix, then A~! A? = J. 


Definition 19. Let A be a square matrix. Then A is said to be orthogonal if AA? = I. 


Example 10. Definition 19 is the same as saying that A~! = A’. 


Theorem 14. A matrix A is symmetric if it can be expressed as A = QDQ7, where Q is an 
orthogonal matrix and D is a diagonal matrix. 


8 


Problem 10. Prove Theorem 14, the problem on symmetric matrix. 


8 


Example 11. Any square matrix A may be decomposed into two terms added together, that is 
A, +A, where A, is a symmetric matrix and A, an antisymmetric matrix, called respectively a 
symmetric part and an antisymmetric part of A. Furthermore, 


As = = (A+ A‘) 


I 


NlR 


and, 


(A- AT) 


Nl eRe 
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